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Abstract 

We initiate the study of the relationship between two complexity classes, BQP (Bounded- 
Error Quantum Polynomial-Time) and PPAD (Polynomial Parity Argument, Directed). We 
first give a conjecture that PPAD is contained in BQP, and show a necessary and sufficient 
condition for the conjecture to hold. Then we prove that the conjecture is not true under the 
oracle model. In the end, we raise some interesting open problems/future directions. 



1 Introduction 



Quantum computing and algorithmic game theory are two exciting and active areas in the 
last two decades. Quantum computing lies in the intersection of computer science and quantum 
physics, and studies the power and limitation of a quantum computer. Algorithmic game theory 
touches upon the foundations of both computer science and economics, and aims to design 
efficient algorithms in strategic circumstances. If we want to come up with some examples 
that are able to demonstrate the interaction between computer science and other disciplines, 
then quantum computing and algorithmic game theory are two perfect candidates. Quantum 
mechanics may provide additional computational power, and quantum computers can test the 
foundations of quantum mechanics. Economics lends some strategic views, and computer science 
rewards with computational points of view. We refer readers to [NCOOj and NRTV07] for more 
information. 

The central topics of quantum computing and algorithmic game theory are the hardness 
of two complexity classes, BQP (Bounded-Error Quantum Polynomial-Time) and PPAD 
(Polynomial Parity Argument, Directed). BQP, as introduced by Bernstein and Vazarani 
|BV97] , characterizes efficient computation of a quantum computer and is the quantum analog of 
BPP. Very little is known about BQP, and a wide belief is that BQP and NP are incomparable 
complexity classes [BBBV971 IBV971 lAarlOj . Papadimitriou introduced the complexity class 
PPAD [Pap94| , which is a special class between P and NP. Since then, the hardness of PPAD 
has also become a longstanding open problem. Although lots of important problems, say the 
problem of computing a Nash equilibrium (NASH for short) |DGP091 ICDT09j . were shown 
to be PPAD-complete, there have been very few relations from PPAD to other complexity 
classes. 

In this paper, we initiate the study of the relationship between BQP and PPAD. The 
representative problem of PPAD is NASH |Pap94| , and the most well-known problem in BQP 
is factoring |Sho97j . Both NASH and factoring are in the complexity class TFNP (the set 
of total search problems, see }MP91j ) in the sense that every instance of NASH and factoring 
always has a solution. Therefore, it seems that there may be some relationship between PPAD 
and BQP. 

In fact, this possible relation was (implicitly) mentioned in a talk given by Papadimitriou 
ten years ago |Pap01| . Papadimitrious said that "together with factoring, the complexity of 
finding a Nash equilibrium is in my opinion the most important concrete open question on the 
boundary of P today" . In other words, Papadimitriou asked: do there exist (classically and 
dcterministically) efficient algorithms for factoring and NASH? As it have been shown that 
there exist efficient quantum algorithms for factoring }Sho97j . it is natural for us to ask: do 
there exist efficient quantum algorithms for NASH? More generally, is PPAD contained in 
BQP? 

Our conjecture is that PPAD is contained in BQP. Formally, 
Conjecture 1 PPAD C BQP. 

The conceived relationship can be illustrated by Figure 1, where the green+red is BQP and 
the red denotes PPAD. 

We will formally define quantum Nash equilibrium, the quantum analog of Nash equilibrium, 
and prove the fact that PPAD is contained in BQP if and only if there exists a polynomial- 
time quantum algorithm for computing a quantum Nash equilibrium. Therefore, to prove the 
conjecture, we need to find an efficient (polynomial-time) quantum algorithm, and to disprove 
the conjecture, we have to show a super-polynomial lower bound for the time complexity of 
computing a quantum Nash equilibrium. 

Another way to express the conjecture is that quantum computers can compute a Nash 
equilibrium in polynomial time, or that quantum computers can exponentially speed-up the 
computation of a Nash equilibrium. And we will rule out this possibility under the oracle 
model. 
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Figure 1: The conceived picture 

The organization of this paper is as follows. Section 2 presents the definition of BQP and 
PPAD, and in Section 3, we introduce the notion of quantum Nash equilibrium and analyze 
it. Section 4 provides the necessary and sufficient condition for our conjecture to hold. Section 
5 proves a lower bound of computing a Nash equilibrium using quantum computers under the 
oracle model. And we concludes the paper with some open problems/future directions in Section 
6. 

2 Preliminaries 

2.1 Notation 

Some notations used throughout the paper are listed here. 

• N: the set of natural numbers, {1, 2,3,.. .}. 

• [n]: the integer set {1, 2, . . . , n}. 

• R: the set of real numbers. 

• \\(f>\\- the 2-norm of a vector <f). If is a quantum state J2x a x\%), then ||</>|| = \f^ x \ct x \ 2 . 

2.2 BQP 

}BV97| introduced the notion of BQP, and a simplified version is as follows. 
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Definition 1 A language L is in BQP if and only if there exists a polynomial-time uniform 
family of guantum circuits {Q n '■ n G N} ; such that 

• For all n G N ; Q n takes n qubits as input and outputs 1 bit. 

• For all x in L, Pr{Q\ x \{x) = 1) > 2/3. 

• For all x not in L, Pr(Q\ x \(x) = 0) > 2/3. 

2.3 PPAD and PPAD-completeness 

Total search problems are problems for which solutions are guaranteed to exist, and the challenge 
is to find a specific solution. In |Pap94| , Papadimitriou defined the following total search 
problem. 

Definition 2 (END-OF-THE-LINE) Let S (standing for Successor) and P (standing for Predecessor) 
be two polynomial size circuits that given input strings {0, 1}™ output strings {0, 1}™. We fur- 
ther require that P(0 n ) = 0" 7^ S(0 n ). The aim is to find an input x such that P(S(x)) ^ x or 
S(P(x))^x^0. 

A more intuitive description of END-OF-THE-LINE is as follows. G is a (possibly exponentially 
large) directed graph with no isolated vertices, and with every vertex having at most one 
predecessor and one successor. G is specified by giving a polynomial-time computable function 
f(v) (polynomial in the size of v) that returns the predecessor and successor (if they exist) of 
the vertex v. Given a vertex s in G with no predecessor, find a vertex t =/= s with no predecessor 
or no successor. (The input to the problem is the source vertex s and the function f(v)). In 
other words, we want any source or sink of the directed graph other than s. 
PPAD was defined based on this problem. 

Definition 3 (PPAD) The complexity class PPAD contains all total search problems re- 
ducible to END-OF-THE-LINE in polynomial time. 

PPAD-completeness was also defined. 

Definition 4 (PPAD-completeness) A problem is called PPAD -complete if it is in PPAD 

and all problems in PPAD can reduce to it in polynomial time. 

3 Quantum Nash Equilibrium 

3.1 Classical Equilibria 

First, we review classical Nash equilibria and correlated equilibria, all of which can be found in 
|NRTV07j . 

In a classical game there are n players, labeled {1,2,..., n}. Each player i has a set Si of 
strategies. We use s = (s\, . . . , s n ) to denote the vector of strategies selected by the players and 
S = XiSi to denote the set of all possible joint strategies. Each player i has a utility function 
Ui : S — > R, giving the payoff or utility itj(s) to player i on the joint strategy s. There is a 
solution concept called Nash equilibrium, in which the equilibrium strategics are known by all 
players, and no player can gain more by unilaterally modifying his or her choice. Formally, 

Definition 5 A mixed Nash equilibrium is a probability vector p = p\ x . . . x p n for some 
probability distributions pi 's over Si 's satisfying that 

y]p-i(s-i)ui(sj, s-j) > , ^2p-i(s-i)ui(s' l , s-i), Vi G [n],VsJ G S^Vs, G Si s.t. pi(sj) > 0, 

S-i S-i 

where s_j is the strategies chosen by players but player i, and p_i denotes the probability 
distribution over s_j. Informally speaking, for a mixed Nash equilibrium, the expected payoff 
over probability distribution of s—i is maximized, i.e. E S i [uj(sj, s_,)] > E s _ 4 [iij(s^, s_j)]. 



3 



We can further relax the Nash condition and define an e-approximatc Nash equilibrium to be a 
profile of mixed strategies such that no player can gain more than e amount by changing his/her 
own strategy unilaterally. Formally, 

Definition 6 An e-approximate Nash equilibrium is a probability vector p = pi x . . . x p n for 

some probability distributions pi 's over Si 's satisfying that 

y^^p-i(s-i)ui(si, s-j) > J~]p-i(3-i)ui(si, s-j) -e, Vi G [n.],Vs- G Si, to* G Si s.t. p l (s l ) > 0, 

S—i S — i 

where e > 0. In addition, the probability distribution of each player may not be independent, 
but correlated, forming the notion of correlated equilibria. 

Definition 7 A correlated equilibrium is a probability distribution p over S satisfying that 
^2p(si, s-i)ui(si, s-t) > J~]p(sj, s_j)uj(Sj, s-j), Vi G [n],\/si,s'i G S*. 

S-i S-i 

Notice that a correlated equilibrium p is a Nash equilibrium if and only if p is a product 
distribution. 

3.2 Quantum Equilibria 

This part generalizes classical equilibria to quantum equilibria, where players are allowed to 
use "quantum" strategies. To be more precise, each player i now has a Hilbert space Hi = 
span{si : Si G Si}, and the joint strategy can be any quantum state p in H = ®iHi. The 
payoff/utility for player i on joint strategy p is Hi{p) = E[itj(s(p))] = ^2 s (s\p\s)ui(s), where 
s(p) is the outcome pure strategy when p is measured according to the computational basis 
{s : s G S}. Note that what each player i can do is to apply an admissible super-operator $i 
on her own space Hi. We sometimes write $i for $j ® J_i. We use CPTP(X) to denote the set 
of all admissible (completely positive and trace preserving) super-operators on a space X. The 
notions of quantum Nash equilibria and quantum correlated equilibria are defined as follows. 

Definition 8 A quantum Nash equilibrium is a quantum strategy p = p\® . . .® p n for pi 's in 

Hi 's satisfying 

J2{s\p\s) Ui {s) > J2( s \Mp)\s)Ms), Vz G [n],V$< £ CPTP(H t ) 

s s 

Definition 9 A quantum correlated equilibrium is a quantum strategy p in H satisfying 
J2{s\p\s)ui{s) > J2( s \Mp)\s)Ms), Vz G [n],V$< £ CPTP(H t ) 

s s 

3.3 Relations between Classical and Quantum Equilibria 

This section studies the relation between classical and quantum equilibria. A quantum mixed 
state p naturally induces a classical distribution p over S defined by 

p(s) = p ss (1) 

While taking diagonal entries seems to be the most natural mapping from quantum states to 
classical distributions, there are more options for the mapping in other direction. Given a 
classical distribution p over S, we can consider 

1- P(P) = T, S P(S)\S){S\, 

3. any density matrix p with p(s) = p ss satisfied. 
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We want to study whether equilibria in one world, classical or quantum, implies equilibria in 
the other world. The following theorem says that quantum always implies classical. 

Theorem 3.1 If p is a quantum correlated equilibrium, then p defined by p(s) = p ss is a 
classical correlated equilibrium. In particular, if p is a quantum Nash equilibrium, then p is a 
classical Nash equilibrium. 

Proof: See the appendix. □ 
The implication from classical to quantum is much more complicated. The following theorem 
says that the first mapping always gives a quantum equilibrium. That is, the utility of i cannot 
be increased for a classical equilibrium even when player i is allowed to have quantum operations. 



Theorem 3.2 If p is a classical correlated equilibrium, then p = S sg s|s)(s| is a quantum 
correlated equilibrium. In particular, if p is a classical Nash equilibrium, then p as defined is a 
quantum Nash equilibrium. 

Proof: See the appendix. □ 
Following this result, we are able to give an affirmative answer to an important problem, 
whether quantum Nash equilibria always exist. 

Corollary 3.3 For all standard game G with finite number of players and strategies, quantum 
Nash equilibria always exist. 

Proof: See the appendix. □ 
The second way of inducing a quantum state is interesting: It preserves (uncorrelated) Nash 
equilibria, but does not preserve correlated Nash equilibria in general. 



Theorem 3.4 There exists a classical correlated equilibrium p with \ip) = -^/p(s)\s) not 
being a quantum correlated equilibrium. However, if p is a classical Nash equilibrium, then 
= ^ s y/p(s)\s) is a quantum Nash equilibrium. 

Proof: See the appendix. □ 
Finally, for the third mapping, i.e. a general p with p(s) = p ss satisfied, the equilibrium 
property can be heavily destroyed, even if p is uncorrelated. (Actually, we will show such 
counterexamples even for two-player symmetric games.) 

Theorem 3.5 There exist p and p satisfying that p(s) — p ss , p is a classical Nash equilibrium, 
but p is not even a quantum correlated equilibrium. 

Proof: See the appendix. □ 
Despite of the above fact, one should not think that the large range of the third type of 
mappings always enables some mapping to destroy the equilibria. 

Theorem 3.6 There exist classical correlated equilibria p, such that all quantum states p with 
p ss = p(s) are quantum correlated equilibria. 

Proof: See the appendix. □ 



4 A Necessary and Sufficient Condition 

In this section, we prove the following theorem. 

Theorem 4.1 PPAD C BQP if and only if there exists a polynomial-time quantum algorithm 
for finding a quantum Nash equilibrium. 

Proof: 

If PPAD C BQP, then for a game G, there exists a polynomial-time quantum algorithm for 
finding a Nash equilibrium p, since finding a Nash equilibrium is a PPAD-complcte problem. 
As shown in the proof of Corollary 13.31 we can always convert p to a quantum equilibrium p 
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in polynomial time. Hence, there exists a polynomial-time quantum algorithm for finding a 
quantum Nash equilibrium. 

Next we will prove the inverse direction for the statement. 

We define a new problem as follows. 

Definition 10 SAMPLE-NASH is a search problem that, on input a game G, outputs a pure 
strategy s sampled from a fixed Nash equilibrium p of the game G. 

Suppose that we are given a game G and we find a quantum Nash equilibrium p in polynomial- 
time using the quantum algorithm. Here we assume that the induced classical probability 
distribution induced from p is p, defined by p(s) = p ss . By measuring p according to the com- 
putational basis {,s : s £ S}, we can obtain a pure strategy s, which is sampled according to p. 
According to Theorem 13.11 p is a classical Nash equilibrium, and therefore s is an output for 
SAMPLE-NASH. So we are able to obtain the output for SAMPLE-NASH in polynomial time. 
Now we have a polynomial-time quantum algorithm for SAMPLE-NASH. 

We have the following result, which is to be proved later. 

Lemma 4.2 A PP 'AD- complete problem can be reduced to SAMPLE-NASH in randomized 
polynomial time. 

Therefore, we have a polynomial-time quantum algorithm for a PPAD-complete problem, 
implying PPAD C BQP. 

□ 

4.1 Proof of Lemma 14.21 

To prove Lemma 14.21 we use the following result. 

Lemma 4.3 WDTOtf 

For any constant c > 0, the problem of computing a l/m c -approximate Nash equilibrium of a 
positively normalized^ m x m bimatrix game is PPAD-complete. 

We just need to reduce the problem in Lemma 14.31 to SAMPLE-NASH in randomized 
polynomial time. 

For an instance of the problem in Lemma [4.31 namely a positively normalized mxm bimatrix 
game G, we use G as the input for SAMPLE-NASH. We assume that we have an algorithm 
A for SAMPLE-NASH, and we want to use A to construct an algorithm for the problem in 
Lemma 14.31 in randomized polynomial time. Suppose the output of A is sampled from a Nash 
equilibrium p = Pi x p%. 

Lemma 4.4 Suppose that p = p\ x p 2 is a Nash equilibrium of a positively normalized mxm 
bimatrix game G, and that the output of A, an algorithm for SAMPLE-NASH, is sampled from 
p. For any e = 0(l/m c ), with high probability, we will get a probability distribution q = q\ x q 2 
with \\q% — Pi\\i < e and | \q 2 — pi\ |i < e, after running A for 0{m 2 e~ 2 ) times. 

Lemma 4.5 Suppose that p = p\ x p 2 is a Nash equilibrium of a positively normalized mxm 
bimatrix game G. Any probability distribution q = q\ x qi with \ \qi —p\ 1 1 1 < e and \ \q2 —pi 1 1 1 < e, 
is a 2e- approximate Nash equilibrium of game G. 

By Lemma l4.41 we can run algorithm A for 0(m 2 e~ 2 ) times to construct a desired probability 
distribution q with high probability. By Lemma 14.51 q is an 2e-approximate Nash equilibrium. 
To find an l/m c -approximate Nash equilibrium, we need to use A for 0(m 2c+2 ) times, which 
is polynomial in input size 2m 2 . 

1 In [CDT09] , the game matrices are normalized in the sense that all the entries are between and 1 (positively 
normalized), or between —1 and 1. 
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4.1.1 Proof of Lemma 14.41 

We assume that player l's to strategies are si, S2, . . . , s m . Define k = [4000m 2 /e 2 ] = 0(m 2 e~ 2 ). 
For each i £ [k], j € [to], define random variable X i3 - taking values in {0, 1}, where X^ = 1 
with probability p\(sj). 

Suppose that e 3 = for each j £ [to]. Define random variables Xj to be Xj = — — — 
for each j S [to] . By Chernoff bound, 

Pr(X 3 > Pl ( S] ) + e 3 )<e- 2 ^ k (2) 

and 

PriX.Kp^-e^^e' 2 ^. (3) 

Define a probability vector q\ to be (Xi, . . . , X m ), which is a distribution over strategies 
(si, S2, . . . , s m ). It is easily checkable that Y) j Xj = 1 and that 

Pr(\\ qi -pilli < £ < E ^ £ ) ^ 1 E 2e_2e?fe W 

j£[m] j'e[m] j6[m] 

> 0.995. (5) 

Similarly, we can get qi satisfying ||<72 — P2II1 < e with probability at least 0.995. By union 
bound, we can get the desired q with probability at least 0.99. 

4.1.2 Proof of Lemma 14.51 

For all i in {1,2}, for all s£ in the set of strategies of player i, and for all Si in the support of 
the set of strategies of player i, we have the following: 



E q-i( s -i) u ( s 'i s -i) - E v-iis-i. 

S—i S-i 


)u(siS-i) 




S—i S—i 


;) -p_ l (s_ l ))"( s j s -0 - 


-^9_ l (s_j)u(s i s_ l ) 

S — i 


<^jj_,(s_ ! )h(s 1 s_,) + -p-i\ 

S — i 


|imaxM(s) — \ q~i{s- 

s — ' 




< }]p-i(s-i)u(siS-i) + e x 1 - 

S—i S—i 


q-i(s-i)u(siS-i) 




<y^(p-i(g-i) - q-i(s-i))u(siS-i) ^ 


- e 




<||g_^ — P-i||i maxw(s) + e 

<(Xl + f 







<2e 

Following the definition of approximate Nash equilibrium, q is a 2e-approximatc Nash equi- 
librium of G. 

5 A Lower Bound under the Oracle Model 
5.1 The Oracle Model 

The oracle model is also called black-box model, or relativized model, and is one of simplest 
models in computer science. Suppose that there is a boolean function / : [N] — > {0, 1}, and 
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that / can be computed in polynomial time. We want to find an x E [N], such that f(x) = 1. 
In the context of PPAD-complctc problems, N, which could be exponential in the size of the 
input, is the number of points in the search space, and f(x) = 1 for x E [N] means that x is the 
answer we desire. For a PPAD-completc problem, there always exists an x £ [N], such that 
f(x) = 1, and the question is that we do not know where it is. Such an / is called an oracle, 
and we want to compute ani€ [N], such that f(x) = 1. 

In an oracle model, algorithms are allowed to make queries to the oracle but are prohibited 
to take advantage of what underlies the oracle. Since we use quantum algorithms here, we can 
also make use of quantum superposition. For instance, for a quantum state a *\ x )i we first 
add some ancilla qubits, obtaining Y^, x a x\x)\0), and then make a single query to the oracle, 
getting Y, x a x \x)\f(x)). 

In summary, in the oracle model, the function / can be seen as the input, and we need to 
design a quantum algorithm to find a solution x E [N] with f(x) = 1, which is guaranteed to 
exist. The time complexity is what we care and is defined to the number of queries made to the 
oracle. 

5.2 The Lower Bound 

We use a hybrid argument of |BBBV97l IVaz04j to show a result when there is only one x E [N] 
such that f(x) = 1, namely for the problems with a single solution. Hybrid argument is 
from a classic paper by Yao |Yao82j , and later has numerous applications in cryptography and 
complexity theory [BM84I IUL891 IHILL99I I1JNW941 lNTs9T1 INis92l IJNW94] . Thus, our proof is not 
new, and existing techniques are enough to prove the result. This is partly due to the fact that 
the oracle model is very well-studied. 

Theorem 5.1 Under the oracle model, to solve a WAD- complete problem with a single solu- 
tion, any quantum algorithm has to make at least Cl(y/~N) queries to the oracle. 

Proof: 

Suppose A is an (arbitrary) algorithm under the oracle model, and it makes k queries to the 
input oracle. If k = f2(iV), then everything is done and we need to do nothing. So a reasonable 
assumption is that k = o(N). 

We define an auxiliary oracle function h : [N] — > {0, 1} with h(y) = for all y E [N]. Such 
an oracle cannot characterize any PPAD-complctc problem, as there are always solutions for 
PPAD-complctc problems while here h means no solution at all. So we use h just purely for 
analysis. 

Run A on h and we call such a run Ah- Let J2 y - y e[N] a y,t\y) the query at time t E [k], 
and let the query magnitude of y to be J2te[k] \ a v,t\ 2 - ^ is not hard to see that the expected 
query magnitude over all possible y is E y (%2 t \ct y ,t\ 2 ) ~ k/N. We have the following claim. 

Claim 1 There exist zi,z 2 G [N] with z\ ^ Z2, such that X)tl a ^i*l 2 — + -0/-^ ant ^ 
EtM 2 <(k + l)/N. 

By Cauchy-Schwartz inequality, we know that J^, |a 2l .t| < (k + and that ^2 t \a Z2 j\ < 

{k + l)/VN. 

Let cj>h,t, t G [k] be the states of Ah after the t-th step. We define two oracles g\ : [N] — > {0, 1} 
and 52 : [N] -> {0,1}: 

• gi(zi) = 1 and for all y ^ z\, gi(y) = 0; 

• 52(^2) = 1 and for all y ^ z 2 , g 2 {y) = 0. 

gi and g 2 are the legal inputs of A and correspond to PPAD-complctc problems. Now run the 
algorithm A on g\ (the run is denoted as A gi ) and suppose the final state of A gi is 4> gi ,k- By 
hybrid argument, we have the following claim. 

Claim 2 \VazO$ 

4>h,k - <f> gu k = Z)t=i E t> where \\E t \\ < \/2\a zll t\- 
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Along with the triangle inequality, we have 



ii^M-^i,*ii < Eh^h 

t 

< s/2^2\a Zl , t \ 

t 

< {k+l)y/2/N. (6) 

Similarly, if we run the algorithm A on (72 (the run is denoted as A g2 ) and the final state of A g2 
is 4> g2 ,k, then a hybrid argument and the triangle inequality could show that 

\\^k-K,k\\<(k + l)VVN. (7) 

If we apply the triangle inequality for another time, we get 

H^W-^WII <2(fe + l)v^7iV, (8) 

implying that 4> gi .k and 4> g2 .k can be distinguished with probability at most 0(k/y/N). Since 
Zi =/= Z2, HA can solve problems corresponding to g\ and (72, namely if A can find zi and Z2, it 
should at least distinguish g\ and 172, and also and 4> g2 ,k with some constant probability. 

As a result, A should at least make Q(y/N) queries. 

□ 

When there are multiple solutions, say p solutions, then k = Sl(y/N/p), which is a straight- 
forward generalization from the theorem above. More formally, 

Corollary 5.2 Under the oracle model, to solve a PPAD- complete problem with p solutions, 
any quantum algorithm has to make at least £l(y/N/p) queries to the oracle. 



5.2.1 Proof of Claim ffl 

Let us suppose that there does not exist zi,z 2 £ [N] with z\ ^ z 2 , such that Et \ a zi,t\ 2 < 
(k + l)/N and Et \ a z2,t\ 2 < (k + l)/N. This means there is at most one z £ [N] such that 
Et K*| 2 < ( fc + l)/JV,'and for all y £ z, y £ [N], Et K,t| 2 > (* + 1)/^. Thus, 



s,t| 



E Ek.*i 2 = EEi^.*i 2+ Ei^ 

y. y e[N] t y.yjtz t 

> EEk< 

> (JV- 1) x (k + l)/N 
= k + 1 - (k + 1)/N 

> k. (9) 

But we have already known that 

EytyeimC^M 2 ) = k/N, (10) 
t 

and that 

E (EK*i 2 ) = fc - ( n ) 

y:y£[Af] * 

The inequality ((9]) and the equation fjl 1[) exhibit clear contradiction. Consequently, our assump- 
tion that there does not exist z±, Z2 £ [N] with z\ 7^ z<z, such that Et l a 2i.t| 2 < (^ + 1)/-^ and 
Et \ a z 2 ,t\ 2 — + 1)/^ i s incorrect. This completes the proof of Claim[TJ 
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6 Concluding Remarks 



On the one hand, it seems that the well-studied oracle model presents us an insurmountable 
obstacle towards an exponentially speed-up using quantum computers for computing PPAD- 
complete problems. If we want to make a step closer to prove our conjecture that PPAD is 
contained in BQP, we have to get rid of oracles and design new structures that can provide 
more information. We believe that this may need fundamental revolution in the field of quantum 
computing. The theory community has spent lots of effort in designing quantum algorithms for 
factoring as well as graph isomorphism, two special problems between P and NP. And now it 
is the time that we turn our attention to the third special problem, NASH, or more generally 
PPAD-complctc problems. 

On the other hand, it seems that purely exploiting the potential of quantum superposition 
is not enough, and quantum entanglement may play a more important role as a resource for 
quantum computation. It is well-known that quantum information theory relies on entangle- 
ment in two quite different contexts: as a resource for quantum computation and as a source 
for nonlocal correlations among different parties. It is strange and not understood that entan- 
glement is crucially linked with nonlocality but not with computation. Quantum computation 
and nonlocality are two faces of entanglement, and more connections should be established in 
the future. 
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A Proof of Theorem 13.11 

Recall that we are given that Pi(p) > fii($>i(p)) for all players i and all admissible super- 
operators $i on Hi, and we want to prove that for all players i and all strategies Si, s[ G Si, 

yjp(Sj, S-i)Ui(Si, 8-j) > J~]p(Sj, S_j)Mj(Sj, S-j) (12) 

S—i S—i 

for p(s) = p ss . 

Fix i and Sj,sJ. Consider the admissible super-operator <£>i defined by 

= Z + ° a 'i) P >*P P H(*i ° S ») ( 13 ) 

where Pt i is the projection onto the subspace span(ti) <8> if-i, and (sj O s'J is the operator 
swapping Sj and sj-. It is not hard to verify that 3>j is an admissible super-operator. Next we 
will show that the difference of pi{p) and pi(§i(p)) is the same as that of the two sides of Eq. 

dun- 

fXi(p) = E[ui(*00)] 

= ^ y^ff(s)Mi(s) + y^^p(SjS-i)Ui(SjS-i) (14) 

Si^Si S—i S—i 

= I>l E ^*P^|5)«i(«) +X)< S K*< ° ^ P iP P sM ^ s'MMs) 

= Z ^PiUs-^Ui^iS-i) +'^2p(s i s- i )u i (s' i s-i) (15) 

Since p is a quantum correlated equilibrium, we have Pi(p) > Comparing the 

above two expressions for and pi(&i(p)) gives Eq. (Ti"2"]) as desired. 

B Proof of Theorem l3~2l 

Let a(Si) = J2 s _ i P{ s i' S -i) u i( s ii s -i) and /3( s i> s D = Z) s _ i -P( S ^ S -0'"i( s i> s -i)- Now for an Y 

we have 

P-i(p) = ^2( s \p\ s ) u i( s ) = ^P( s ) u i( s ) = ^^p(s,S-,)«,( s - s -.) = ^2 a ( s i) ( 16 ) 

where the first two steps are by the definition of pi and p. Now for an arbitrary TPCP super- 
operator we use its Kraus representation to obtain 

k 

= Y,( A ij ® i-i)p( A *o ® 7 -) ( 17 ) 



with constraint J2j=i A*jAij = where Ii is the identity super-operator from L(Hi) to L(Hi). 
Now we have 

l*(*i{p)) = // by the def of p, 

k 

= E< s 'i E^« ® 7 -*>K- ® ^fhoo 

= EE< s 'K i « «I-i)£pW|«)H)(4 gl-Ola'K-C*') // b y tbc def of p 

s' J = l s 

k 

= E EE^ ® J -» w ® /-ii« , >p(«)«i(*') 

s' s 3=1 
fc 

= E EEwi^i'*>< 8 «i4i 4 '^( 8 '' j *) // b ^ the def of ft a *> ^ 

s 'i Si 3 = 1 

Note that {s' l \A ij \s l ){s i \A* :j \s l l ) = \\{s' i \A ij \s l )\\ 2 > 0, thus by the assumption that /3(sj,sQ < 
a(s^) (i.e. p is a classical correlated equilibrium), we have 

fc 

m(Hp)) < EEEM^i*><*i^>«(*) 

fe 

= EEW'(EMM)^i*> a W 

s i j=l fi- 
fe 

= E<*iE^ 4 «i s< > a W) 

Si 3=1 

= E^i si ) a ( Si ) 

where the last equality is by Eq. (fT6|) . This completes the proof of Theorem 13.21 
B.l Proof of Corollary [3JJ] 

We will reduce the existence of a quantum Nash equilibrium to the existence of a Nash equilib- 
rium. 

For a given game G with finite players and finite strategics, there always exists a Nash equi- 
librium, say p. We transform p into a quantum state p using the the mapping p = 5Z s p(s)|s)(s|. 
By Theorem 13. 21 p is guaranteed to be quantum Nash equilibrium of G. 

Thus, quantum Nash equilibria always exist. 



C Proof of Theorem ET51 

C.l Examples of the First Statement 

Define utility functions of Player 1 and 2 to be: 



A = 



270 126 
270 



Suppose the initial state is 



IV) = vX^loo) + vV6|oi) + VX^lio) + vT/siii), 

whose corresponding density matrix is 



1/3 v/I/IS y/TJTE 1/3 



v/1/18 1/6 1/6 v/l/18 
y/t/18 1/6 1/6 y/l/18 
1/3 v^TTs v^/TS 1/3 . 

and whose corresponding classical correlated distribution is 

1/3 1/6 
1/6 1/3 



which is easily verified to be a classical correlated equilibrium. 

However, p is not a quantum Nash equilibrium. Define a unitary matrix 



G = 



Consider 



^2/3 v/173 ' 
/T73 -J^JZ. 



1/2 y/2/3 -1/6' 
v^/3 4/9 -v^/9 







P = {G®I)p{G®I) = 

-1/6 -V2/9 1/18 
It is easily seen that p' has higher expected utility value for player 1, actually 

tn(p') =206, /ii(/9) = 201. 
C.2 Proof of the Second Statement 



Let p = |0) (VI = Ea,fc n/p(o)p(6)|o)(6|. Then 

= ^( S |^V^Mfe)|a)(6|| S )^( S ) 

s a,t> 

= /,Pi(Sj) /,P-i(S-i)Ui(Sj, S-j) 
Si:pi(s;)>0 s-i 

Now assume that Player i applies an admissible super-operator on p: 

k 

Hp) = Y^ A » ® j -0p(^« ® 



where V* , A^Ay /,. 

Let Si be a strategy s.t. Pi(si) > 0. Then by the definition of Nash equilibrium, we have 

^p_i(s_j)wj(.s l s_ i ) < y^^p_i(s-i)ui(siS-i), (18) 

Si Si 

for any s^. 

s 

k 

= E< S I E^ ® ® ^-i)l«>«i(«) 

s 3=1 

= E< s l E( A « ® E v^(«M&)l«><W ® J-0l«M«) 

■s j — 1 a, 6 

= ^ V<P(o)p(6)<*|(^3 ® I-i)|o)(6|(^ ® J_<)|*}u<(«) 

s,a,b,j 

= E V Pi(at)p l (b i ) ^Jp_ i (a- i )p-i{b^ l ){s i |a 4 ) (s_, |a_<) (fy |^ |s<) (6_< \s-i)Ui(s) 

s,a,b,j 

= ^2 ^p l (ai)pi(b l )(si\A l j\a l )(b t \A* j \si}p- l (s-i)u i (s l , s-i) 

Si,S — i : CLi,bi ,j 

= E \/pi(a t )p i (b i )(s t \Ai : j\a l )(b l \A* J \s t )p^ i (s^ t )u t (s l ,s^ i ) 

Si,s_ i ,a i ,bi,j:p i (ai)>0,Pi(bi)>0 

= E Vpi(ai)pi(bi)(si\Aij\ai) (bilAZAsj) 22P-i( s -i) u i( s h s -j) 

Si,ai,bi,j:pi(a,i)>0,pi(bi)>0 S-i 

< E V Pi {aj jpi (pijjsi \Ajj\ di) {h\A* i:j | p-j (s-j)uj (a,; , s_j) 

s j ,o i ,6 i ,3:p i (a i )>0,p i (6 i )>0 s_ 4 



= E \/PiK)Pi(&i)(fri|-^i 7 -|si)(si|^ul a ») y^P-.(s-i)M i (a„S-,) 

Si ,Oi,6i ,3':p< (et«) >0,pi (6« )>0 s-« 

= E y/p. t (aJp^(& i )(& i |A* 7 ^ J |at) y^p_. t (s_J^(a t ,s_ t ) 

a i ,6 i ,j:j) i (o»)>0,p i (6 i )>0 s-i 

= E \/pi(fl»)p»(ft»)(ft»|ai) y^P^ts-.)"^., s-i) 

a,i,bi:pi(a,i)>0,Pi(bi)>0 s-i 

= ^ Pj(Sj)^p_i(s_j)Uj(Si,S_i) 
Si:pi(s ; )>0 s-i 



This completes the proof of Theorem [ 

From the above proof, one can see that if supp(pi) = Si, then the only inequality becomes 
the equality. We thus obtain the following fact. 



Corollary C.l Ifp is a classical Nash equilibrium and supp(pi) = Si, then \ip) = ^ s y/p(s)\s) 
is a quantum Nash equilibrium, and any quantum operation by Player i does not change his/her 
utility value. 



D Examples in Theorem 13.51 



Define the utility matrices of both Player 1 and Player 2 to be: 



U\ = U2 = U 



2 1 
1 2 



Note that since u is symmetric, so is the game. Below we will show a couple of 
where p p is a classical (sometimes correlated) Nash equilibrium but p itself is not a 
(correlated) Nash equilibrium. 

Example 1: a mixed product state 

Suppose the initial state is 



examples 
quantum 



P 



cos 2 (0) cos(0)sin(0) 
cos(0)sin(0) sin 2 (0) 



®|0><0| 



sin 2 (0) 
cos(0) sin(0) 



cos(0) sin(0) 
cos 2 (0) 



®|1><1| 



cos 2 (0)/2 
cos(0) sin(0)/2 



cos(0) sin(0)/2 
sin 2 (0)/2 -cos(0)sin(0)/2 
sin 2 (0)/2 

cos(0)sin(0)/2 cos 2 (0)/2 



Take the diagonal elements to form a classical correlated distribution 



P 



cos 2 (0)/2 sin 2 (0)/2' 
sin 2 (0)/2 cos 2 (0)/2 



which is easily verified to be a classical correlated equilibrium if cos 2 (0) > 1/2. 
However, p is not a quantum Nash equilibrium. Define a unitary matrix 

G 

Consider 

p' = (G ® I)p(G <g> /) 



cos(0) sin(0) 
sin(0) - cos(0) 



1/2 











1/2 



It is easily seen that p' has higher expected utility value for player 1, actually 

Hx{p')=2, p^p) = l + cos 2 (0). 

Example 2: an entangled pure state 

Consider 

cos 2 (0) cos(0)sin(0) cos(0)sin(0) -cos 2 (0) 

1 cos(0)sin(0) sin 2 (0) sin 2 (0) - cos(0) sin(0) 

P_f> cos(0)sin(0) sin 2 (0) sin 2 (0) - cos(0) sin(0) 

-cos 2 (0) - cos(0) sin(0) - cos(0) sin(0) cos 2 (0) 



(19) 



(20) 



Since the diagonal entries are the same as those in Eq. (|1Q|) , the induced classical distribution is 
also the same as before, which is a classical correlated equilibrium. Again, p is not a quantum 
Nash equilibrium since 



p' = {G <g> I)p(G <g> /) 
and it is easy to see that Hi(p') = 2. 



1/2 1/2' 




1/2 1/2 



Example 3: (uncorrelated) Nash equilibrium 

Suppose 



P = 



The induced classical distribution is now 



1/4 


1/4 


1/4 


-1/4 


1/4 


1/4 


1/4 


-1/4 


1/4 


1/4 


1/4 


-1/4 


-1/4 


-1/4 


-1/4 


1/4 



1/4 1/4' 
1/4 1/4 



It is easy to check that this is a classical correlated equilibrium. Consider 



pf = {H® I)p{H <g> I) 



1/2 



1/2 



1/2 



1/2 



where H is the Hadamard matrix. Here /ii(p') = 2 > pi(p). Therefore p is not a quantum Nash 
equilibrium. 



E Examples for Theorem 13.61 

Define the utility matrices of both Player 1 and Player 2 to be: 



Ul = U'2 = U 

Consider the classical correlated distribution 



2 1 
1 2 



1/2 
1/2 



(21) 



(22) 



It is easy to check that this is a classical correlated equilibrium. 

For any quantum state p with p ss = p(s), the expected utility value for player 1 is given by 
/iti(p') = 2. It is impossible to have any density operator p' with pi(p') > 2. It is easy to see 
that the expected utility value is maximized so p is a quantum Nash equilibrium. 



